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ABSTBACT 

This study exanined whether student attitude toward 
instructors was related to subseguent behavior such as the behavioral 
intention to take further courses with that instructor, and whether 
social desirability affected this relationship. Students completed 
instructor rating and social desirability scales. Principal 
conponents analysis and variaax rotation isolated six instructor 
rating factors, students also participated in a mock preregistration 
procedure assessing their intention to reregister for the saae, or 
different instructors. Besults indicated that the first instructor 
rating factor. Instructor Skill, correlated .72 with intention to 
take further courses with that instructor, ho other relationships or 
interactions were significant. (Author) 
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Student evaluation of instruction is becoming increasingly commonpidce 
at ail educational levels (U.S. President's Commission, 1970). 32iere is 
a growing body of research regarding the reliability of sich assessments, 
the degree to which such measures correlate with other variables such as 
achievement (Gostin,P., Greenough, W.T. & Menges, RJ., 1971), and 
teacher-student similarity (Good & Good, 1973). Attitudes are assumed 
to be both responses and stimuli for further responses which both initiate 
and maintain behavior (Staats, 1967). Positive attitudes towaids a partic- 
ular subject matter, then, suggest that the student is likely to expose 
himself, and delve more deeply into the area than he would if attitudes 
were negative. Similarly, positive attitudes towards an instructor ought 
to imply that, given the opportunity, the student would be likely to take 
further study with the same teacher. Negative attitudes, conversely, 
should imply that the student is likely to avoid studying with an instructor 
in the future. It was the purpose of this study to test these expectations. 

The monitoring of students* future choice of instructors generally imposes 
formidable procedural problems. Longitudinal studies of the problem may 
be affected by error variance from sources such as schedule contingencies, 
convenience, and other variables in the students' life which contribute 
to the selection of instructors . One way of assessing whether students 
are likely to continue study with an instructor which is free from the proced- 
ural complexities alluded to above is to determine their behavioral intention. 




Pishbein (1971) has shown that actual behavior correlates as high as 
• 90 wiih behavioral intention when that intention is a commitment to 
a highly specific behavior. Thus, a clear-cut measure of the students 
intent to take a further course with a particular instructor is likely to 
be highly correlated with whether a student actually does so. Since 
intention may be detennined concurrently with the attitude measure, 
it is less likely to be contaminated with the convenience factors allud- 
ed to above. 

Many questionnaires dealing with students' evaluation of instructors 
include items such as: "Would you take another course with this in- 
structor?". While such an item appears to measure students* intention, 
the fact that it is embedded in a general attitude scale, and does not 
require any commitment on the students part to specific behavior makes 
it doubtful whether such a question can be considered a legitimate meas- 
ure of intent. For that reason, in the present research behavioral intent 
was evaluated by an experimental manipulation in which students were 
asked to pre-register for next semester's courses, rather than just indi- 
cate their attitudes . 

A further source of ambiguity in student ratings of instructors may be the 
social desirability variable. It is generally considered impolite to ex- 
press strong negative feelings towards the work of another individual. 
Students with high tendencies towards responding in socially desirable 
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directions are, tliereforo, less likely to express criticism as frankly 
or directly as students with lower social desirability tendencies. 
Crowne and Maricwe (1964) found that high SD students rated c. 
boring experiment significantly more favorably than students lower 
in SD as assessed by the Marlowe-Crowne Social Desirability Scale 
(Crowne & Marlowe, 1964). Furthemore, an interaction between social 
desirability and intention to re-register may be expected. Students may 
rate an instructor more favorably than they actually feel towards him 
due to high social desirability tendencies. However, their ratings may 
be unrelated to the intention to take further course work with that instruct- 
or Since they can always find socially acceptable excuses for not doing so. 
Therefore, social desirability may act as a moderator between the intention 
to re-register for a course and evaluation of the instructor. Specifically, 
students high in social desirability and attitude are iggs. likely to re-regis- 
ter for that instructor than those with comparable attitudes who are lower 
in social desirability. 

Method 

This study v/as carried out by administering an evaluation of instruction 
questionnaire to students in which social desirability (SD) items were 
embedded. A mock pre-registration survey was then conducted in which 
students were asked whether they wished to register for the same instruct- 
or, or a different one in the second tern of the Educational Psychology 
course they were presently taking. 
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■Procedure & Snhjcr^tg 

The rating scale used . this study was based on one reported by 
McKeachie (1971) , tliii foUowing modifications were made to that 
scaie: 1) Items containing proper pronouns such as "he, " were 
changed to read either "instructor" or "teacher, " since some of the 
instructors used in the present resef.rch wsre female. 2) Items 
were omitted if the factor analysis results reported by McKeachie 
(1971) indicated that less than 10% of the tota^ item variance was ac- 
counted for by the anlysis, or that no single loa^nng on any factor was 
greater than .20. The final version of the scale included 32 items. 

Six items from the Marlowe-Crowne Social DesimbiUty scale (Crowne 
& Marlowe, 1964) were randomly interspersed with the instructional 
items. This short form of the scale has been reported to have a coxTe- 
iation of .86 with the total scale (Greenwald & Satow, 1970). 

Students were jiot required to give their names on the instructor rating 
scale. After this scale was completed students were informed that a 
pre-registration procedure for the succeeding semester's educational 
psychology classes was being conducted. In oitier to help the school 
plan effectively with respect to assigning instructors to courses, students 
were asked to indicate whether they planned to take the second educaUon- 
ai psychology course with the present instructor, or a different one. The 
pre-rogistration sheet appeared similar to fomal departmental communi- 
cations generally sent out to students, and as far as could be ascertained 
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was t^ken at face value. 

Data was collected in March and April, 1974, during a regularly sched- 
uled class period . Instructors were absent from the classroom during 
the administration of the forms . Debriefing of students as to the pur- 
poses of the experiment did not occur until data from all of the classes 
had been collected . Students were infonned tiiat the instructor rating 
form was being administered for research purposes . 

A total of 158 students in seven educational psychology classes at the 
City College of New York served as subjects. 

Results 

Responses to the instructor rating scale were submitted to a principal 

components factor analysis and varimax rotation. A total of seven 

factors with Eigen values above one were extracted . Since the first 

six factors yielded the most interpretable solution, and appeared most 

similar to results reported by McKeachie (1971) this solution was used 
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for further analysis , 

Of the six interpretable factors used in this study, the first factor label 
ed Instructor Skill accounted for .30 of the total variance, and .48 of 
the common variance . Factors two through six were identified in order 
as: 2) Evaluation and Feedback, 3) Friendly Classroom Atmosphere, 
4) Classroom Organization, 5) Standards, and 6) Assignments, All 
together these factors accounted for ,33 percent of the total variance. 
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Factor scores for each student were then computed on the basis of these 
results . 

The relationship between factor scores and students' intention to re« 
register were examined by stepwise multiple regression analysis. 
Since an interaction between SD and instructor raUng had been pre- 
dicted, the SD items were averaged, and interaction tems for each 
factor developed by cross multiply- factor scores with the SD means . 
A total of thirteen scores were then available as independent variables 
for each student; the six factor scores, the mean SD score, and six 
interaction terms . The criterion consisted of the students' intention 
to re-register for the same instructor in the succeeding semester. 
Due to missing data the regression analysis was based on the total 
of 116 subjects. 

In the regression analysis no predictor variable was forced into the 
equation, thus, the 13 predictors could enter the equation in the order 
with which they accounted for independent variance in the criterion. 
Only the first factor. Instructor Skill, entered the equation. The 
correlation of this facto, with the criterion was .72, accounting for 
52% of the variance In the criterion, and yielding an F of 124.49, 
significant beyond the .001 level. Neither SD, nor any other radng 
scale factor, nor any interaction term between SD and any factor 
accounted for significant variance in the criterion, whether factor 1 
was partialled out, or not. mth fdctorone perfclalled out, factor 
four. Organization had a correlation of - .14 with the criterion, and 



factor two, Evalualion and Feedback, corrokted .10 with the criterion. 
Neither of these were significant at the .05 level. The rer)'<aining 
partial correlations were ail below .10, and, of course, non-signifi- 
cant. None of the correlations between sny of the factors and SD were 
significant, neigher wr^e the correlations between SD, and the criterion. 

Discussion 

The results of this study indicate that a factor of generalized teacher 
competence is strongly associated with student intention to take 
further coursework with an instructor. Furthermore, all of the dimen- 
sions of students' rc! ting of instructors appeared relatively unaffected 
by SD. Finally, SD was unrelated to students intention, nor did it 
interact with any of the factors to modify students? intentions . 

The results of this Investigation provide evidence favoring the use of 
student ratings of Instructors. The findings Indicate that students* 
attitudes toward Instructors are such that they appear to be highly 
related to the llkllhood that the students will expose themselves to 
the same Instructor again. If one of the outcomes of Instruction is 
considered to be arousing motivation to learn more from a particular 
instructor, the results of this study provide evidence for the validity 
of the use of student ratings for this purpose . 

It may be interesting to employ similar procedures In attitude scales 
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administered in innovative educational programs. When such progmms 
are evaluated, students* attitudes towaids the innovation typically 
provide an important source of data. Yet, the critical test of the 
importance of student attitudes towards such innovations would ap- 
pear to be whether students, given the choice, would be Ukeiy to 
request further instruction by the innovative methodology, or by a number 
of comparable instmctionai stmtegies. It would appear that a truly 
successful instructional procedure would be one which, in addition 
to enabling students to master instructional objectives, would be 
freely selected by students for further study. Failure to select a 
particular instructional method in the future, even if such instruction 
results in the accomplishment of instructional objectives, would imply 
that the me&odology was ultimately unsuccessful since students re- 
sisting exposure to such instruction are eventually likely to sabotage 
it. To test the applicability of this method of evaluation for these pro- 
grams, it would appear to be useful to pretend that additional modules, 
or lectures, or instructional programs are available. Students could 
then be a^^ked to register for the additional instrucUon eitiier by select- 
ing the new strategy, or any others . Such evaluation may be of consider- 
able imp:>rtance in determining the usefulness of different instructional 
methods . 

Ihe failure cf social desirability to contribute significantly to th*. results 
was quite unexpected. Two aspects in the procedures of this investiga- 
tion may have contributed to this finding. First, students were not 
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required to supply their names on either the instructor rating sheet, 
or the pre-registration form. Such anonynjity may have worked 
against the importance of social desirability, since students were 
aware of the fact that they were anonymous and could not gain any 
approval by pretending to have more favorable attitudes than they 
actually possessed. Second, administration of the instructor rating 
scale was presented as being part of a research project. Students 
could, then, feel that there was Uttle consequence to the instructor 
as a result of the attitudes expressed. Students may also have be- 
lieved that the instructors would never be informed of the ratings 
even in terms of means, and hence may have seen little reason fcr 
pretending more favorable attitudes than they held. Perhaps future 
investigations with modification in these aspects of the procedures 
may find social desirability contributes more importantly to student 
ratings . 
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Footnotes 



1. This study was partially supported by the Division of Teacher 
Education, of The City University of New York, Special gratitude 
is extended to Dr. Max Weiner for makint, resources for the con- 
duct of this study available, and to the instructors for volunteer- 
ing to participate. 

2. Now at the New York City Boaid of Education. 

t 

3. Copies of the questionnaires used in this study, the correlation 
matrix, the principal components output, and the varimax rota- 
tion results will be deposited in the National Auxiliary Publication 
Service (number to be supplied at a later date). 
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INSTRUCTIONS: W© are Interested in people's 
«ttxtud6s toward instructors, courses, and 
a number of social situations. Please read 
the questions below and indicate on the scale 
«t the right how often each of these behaviors 
occurs by plaoins an "X" in Che appropriate 



1. In this class students learned'how to think more 

Clearly about the subject matter of this course. 

2. In this Class students gained a great deal "of 

knowledge about this content. 

3. Students argued with one another or with the 

Instructor, not necessarily with hostility 



4. The instructor appears sensitive to students 
feeling and problems. 



5, The insTrllccor was skillful in observing studeivE 
reactions. 



— I.I.I ■ ian„||iM, __, ^ ..LJi niii J LL j i.— -- 

6, The inatuctor stressed high quality work. 

7 The teacner was pennlssive and flexible. 

6. The instructor discussed test material after"" 
each quiz or exam. 

9. The teacher continual J yTmphaa ized grades 



10. In this class. I felt free to ask questions, 
to express my opinions, and disig^^ee- 



II. .1 sometimes fell resentful when I don't get" my 
Own way-. ^ 

The instructor was fair in grading and evaluation?"" 



13. The teacher list'ened attentively to what class 
nembers had to say. 



14. I am quick to admit making a mistake. 



15. This course was well -organized. 



16. The instructor kept students wfiU-infotmsd of 
their progress. 
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17. 1 have soiRetiaies taken unitiir advantage 
o£ another cerson. 








t 
1 


lii^ The teacher told students waea th^y had 
dona 3 i^aiTuicularlv stood 1ob# 










, 


1$. Tno instructor asais^e^ vtsry difficult 












20^ The tcach^tr vas friendly < 












21/ The stadt^nts in the class vere friendly. 












22. The instructor increased th^ interest of 
claas m^tnberj in this class* 












23/ The students rrequencly volunteered their 
ovn opinions. 








1 




24^" Ko t^atter who Vixi talking to, I^m c^lways 
a good listener. 













25* THe content of examinatioris was appropriate. 


' 1 






1 ^ 


26. X 30si2i:iir.e6 try to get even rather than 




1 

• 








2'/. The ceacher lets students know whan they 










— , 


28. The instructor had everything going according 






1 






29. The teacher v/as tolerant of students opinions. 












30. The instructor followed the outline closely. 












31. The teacher explained clearly and the 
explanations were to the point. 












32. The instructor stimulated the intellectual 
curiosity of the students. 












'33. The instructor put his material across in 
an in Ct! re sting way. 

• 













o 

ERIC 



16 



38. 



^lll^lt ^'^^^'^^^^ general <all-aro.nd) teaching 

an outstanding and stimulatlns Instructor 

a very good Instructor ■ 

r.__^ good instructor 

'"''^ ^^^^^t^S instructor 
_a poor and inadequate instructor 



How would you rate the overall value of this course? 



jauparlor 

very good 

Uood 

fair 

p oor 



Please feel free to add any additional comments below. 
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The City College 
SCHOOL OF EDUCATION op«,- 

8KT copy mmii 



We are presently organizing next semester *s schedule. 
The next course in the education sequence, ED 36, will be 
taught by your present instructor as well as others. In 
order to plan effectively, please indicate whether you intend 
to take the next course with the same instructor. 



Yes, I will be 

taking ED 36 with 

my present instructor.. 



No, 1 will be 

taking ED 36 with 

a different instructor. 
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